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ABSTRACT 


A  digital  computer  simulation  model  was  previously  derived  and  em¬ 
ployed  for  simulating  the  performance  of  the  operator(s)  in  a  man-machine 
system.  The  technique  is  based  on  an  analysis  of  the  performance  of  each 
operator,  arranged  into  ordered,  discrete  actions  called  "subtasks, "  and  the 
compilation  for  each  of  certain  source  data.  These  data,  together  with  selected 
parameter  values  (e.  g. ,  the  time  allotted  for  taBk  performance),  are  placed  in 
punched  card  form  and  introduced  into  a  digital  computer  which  sequentially 
simulates,  according  to  the  rules  of  the  model,  the  "performance"  of  each  sub¬ 
task  by  each  operator.  The  normal  sequence  of  subtasks  may  be  modified  if 
actions  have  to  be  skipped  or  repeated  due  to  failure  of  a  subtask  by  either  oper¬ 
ator  or  as  a  result  of  operator  decisions.  A  simulation  is  completed  when  the 
operators  either  use  all  allotted  time  or  successfully  complete  the  task.  Re¬ 
sults  are  recorded  indicating  the  areas  of  operator  overload,  failure,  idle  time, 
peak  stress,  etc. ,  for  the  given  set  of  selected  parameters.  Repetitions  of 
the  simulation,  with  different  parameter  values,  yield  a  range  of  records.  Fre¬ 
quency  distributions,  summarized,  and  reduced  data  are  provided  automatically 
by  the  computer,  and  from  these,  graphs  and  charts  of  performance  may  be 
prepared. 

Since  the  development  of  the  original  model,  a  number  of  possible  mod¬ 
ifications  have  become  apparent.  These  modifications  involve:  (1)  a  newly 
developed  and  modified  stress  formulation,  (2)  a  random  interrupt  feature. 


-  i  - 


(3)  an  alternate  method  for  calculating  subtask  execution  time,  (4)  changes 
to  incorporate  the  individuality  factor  in  the  urgency  and  stress  calculations, 
(5)  an  "equipment  delay"  simulation  feature,  and  (6)  imposition  of  an  upper 
limit  of  the  stress  on  the  simulated  operator. 

Moreover,  although  logical  expectancy  indicated  the  model  to  be  usable 
for  either  one  or  two  operator  systems,  the  model  had  never  been  exercised 
on  a  uni-operator  system.  Accordingly,  the  present  study  focused  on  inves¬ 
tigating:  (1)  the  applicability  of  the  model  to  uni-operator  situations,  and 
(2)  the  effects  of  the  modifications  on  the  agreement  of  the  results  from  appli¬ 
cation  of  the  model  with  criterion  data. 

The  results  suggested  that  the  model  is  usable  for  uni -operator  and 
for  two-operator  simulations.  The  modified  model,  which  demonstrated 
general  reasonableness  and  rationality,  also  achieved  an  agreement  level 
with  outside  criterion  data  that  had  not  been  previously  accomplished. 
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CHAPTER  I 


INTRODUCTION 


Background 

For  several  years,  Applied  Psychological  Services,  under  Office  of 
Naval  Research  sponsorship,  has  been  engaged  in  the  development  and  evalu¬ 
ation  of  digital  computer  techniques  for  the  simulation  and  prediction  of  oper¬ 
ator  performance  in  man-machine  systems.  The  initial  efforts  resulted  in  the 
development  of  a  model  for  a  single  operator-machine  system  in  which  an  oper¬ 
ator's  task  performance  is  simulated. 

This  uni-operator  man-machine  system  model  was  formulated  for  the 
IBM  650  digital  computer  using  the  SOAP  programming  technique.  The  tasks 
of  landing  an  F4D  aircraft  on  an  aircraft  carrier  and  launching  the  Sparrow  HI 
air-to-air  missile  were  simulated  by  the  computer  and  reported  (Siegel  and 
Wolf,  1959a,  1959b).  This  one-man  model  incorporated  provisions  for  vari¬ 
ations  of  operator  speed,  task  time  allowance,  operator  idle  time,  stress 
breakpoint,  ignoring  of  non-essential  subtasks  when  the  operator  is  under  time 
stress,  operator  decisions,  and  equipment  failures. 

Then,  the  model  was  generalized  and  expanded  to  accommodate  systems 
manned  by  one  or  two  operators.  The  team  model  was  organized  for  the  IBM 
705  HI  computer  using  the  AUTOCODER  programming  technique.  In  addition 
to  the  features  of  the  one -operator  model,  the  expanded  version  also  provided 
for  operator  communication,  calculation  of  team  "cohesiveness,  "  and  waiting 
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for  the  partner.  Additionally,  the  computer  was  programmed  to  perform  a 
greater  amount  of  the  tabulation,  summarization,  and  other  processing  of  the 
results  previously  manually  performed. 

This  team  model  was  first  applied  to  the  task  of  in-flight  refueling  of 
an  F8U  aircraft  from  an  A4D  tanker  (Siegel,  Wolf,  and  Crain,  1961).  A  sec¬ 
ond  application  of  the  expanded  model  was  made  to  the  task  of  intercepting  an 
intruding  aircraft  by  an  advanced,  supersonic  naval  aircraft  manned  by  a  pilot- 
radar  observer  team  (Siegel  and  Wolf,  1961).  In  connection  with  this  second 
application,  the  model  was  modified  to  incorporate  a  revised  value  of  time  to 
simulate  skipping  a  non-essential  subtask. 

Most  recently  (Siegel,  Wolf,  and  Sorenson,  1962),  the  two-man  model 
was  again  expanded  and  the  results  obtained  from  application  of  the  model 
were  compared  with  the  results  achieved  in  a  controlled  two-operator  task. 

Two  sets  of  electric  trains,  each  under  control  of  a  carefully  selected  oper¬ 
ator  subject  were  used  to  enact  a  military  task  in  which  perceptual -motor  be¬ 
havior,  interoperator  communication,  cooperative  action,  branching,  selection 
of  strategy,  and  skipping  of  non-essential  subtasks  were  included.  This  (Siegel, 
Wolf,  and  Sorenson,  1962)  study  also  reported  a  number  of  additional  changes 
in  the  model:  (1)  providing  for  the  case  in  which  one  operator  makes  a  "team" 
decision  for  both  himself  and  his  partner,  (2)  providing  for  the  actions  of  one 
operator  to  be  dependent  on  whether  his  partner  performed  or  skipped  a  given 
subtask,  and  (3)  providing  for  an  operator  to  skip  a  group  of  subtasks  as  well 
as  individual  subtasks  under  certain  circumstances. 
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The  Current  Study 

As  a  result  of  the  laboratory  data,  added  experience  in  evaluating  com¬ 
puter  data,  and  a  need  to  expand  still  further  the  range  of  usefulness  of  the  sim¬ 
ulation  method,  several  additional  modifications  have  been  made  to  the  model. 

A  descriptive  compilation  of  the  model  in  its  current  status  is  given  in  the  next 
chapter  of  the  present  report.  A  review  of  the  current  operational  aspects  of 
the  computer  program,  operator  instructions,  card  and  tabulation  format,  and 
the  like  are  given  in  Chapter  III. 

Since  some  of  these  modifications  were  made  on  an  exploratory  basis, 
several  computer  simulation  runs  were  made  to  determine  the  effects  of  the 
changes  in  the  model.  In  selecting  a  task  on  which  the  changes  could  be  eval¬ 
uated  several  criteria  were  considered.  In  addition  to  selecting  a  task  which 
exercised  the  various  features  of  the  model,  there  had  been  for  some  time  the 
question  of  how  well  the  two-operator  model  would  perform  in  the  case  of  a 
single  operator  task.  The  selection  therefore  was  to  simulate  first  the  uni¬ 
operator  controlled  launching  of  a  Sparrow  III  air-to-air  missile  as  previously 
reported  (Siegel  and  Wolf,  1959b)  prior  to  any  changes  in  the  model.  Follow¬ 
ing  this,  the  desired  changes  were  incorporated  into  the  logic  of  the  computer 
program  and  the  simulations  rerun  to  study  the  effects  of  the  changes.  Chap¬ 
ter  IV  contains  the  results  of  both  sets  of  these  computational  runs. 
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CHAPTER  II 


THE  REVISED  MODEL 


Input  Data 

The  following  is  a  description  of  the  current  stochastic  model  for 
simulating  one  or  two -operator  systems.  To  use  the  model,  14  items  of  input 
data  are  required  for  each  subtask  (i  =  1,  2, ....  n),  and  each  operator  (j  =  1,  2). 
These  data  may  be  derived  from  such  procedures  as  task  analysis,  literature 
search,  or  personal  interviews.  The  required  input  data  for  each  operator  are 


1 .  average  subtask  execution  time,  ty :  the  average  time 
required  by  the  jth  operator  to  perform  subtask  i.  This 
average  value  represents  the  case  in  which  the  operator 
is  under  no  stress.  Examples  of  values  suggested  from 

•  various  sources  as  tentatively  applicable  for  represen¬ 
tative  subtasks  are  shown  in  Table  1 . 

2.  average  standard  deviation,  o-^j:  taken  around  the  ty  for 
the  average  operator  while  not  under  stress.  Examples 
of  values  for  these  data  are  also  shown  in  Table  1. 

3.  average  subtask  probability  of  success,  py:  the  probabil¬ 
ity  that  the  average  operator,  j,  while  not  under  stress, 
can  perform  subtask  i  successfully. 

4.  indication  of  subtask  essentially,  E^:  an  indicator  specify¬ 
ing  whether  or  not  the  successful  performance  of  subtask  i 
by  operator  j  is  essential  to  successful  completion  of  the 
task.  This  datum  allows  the  computer  to  identify  and  ig¬ 
nore  non-essential  subtasks  during  "highly  urgent"  condi¬ 
tions. 

5.  idle  time  requirement,  1^:  the  point  in  time  before  which 
operator  j  is  not  permitted  to  begin  subtask  i. 

6.  indication  of  whether  subtask  i  is  a  decision  subtask  or  a 
normal  action  subtask.  A  decision  subtask  is  a  subtask  in 
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which  the  computer  simulates  a  choice  or  decision  made 
by  the  operator,  without,  however,  the  operator  taking 
any  action, 

7.  subtask  number,  (i,  j)f :  to  be  performed  next  by  operator  j 
if  he  fails  at  subtask  i,  or  if  he  chooses  the  first  of  two 
alternative  courses  in  a  decision  subtask. 

8.  subtask  number,  (i,  j)s:  to  be  performed  next  by  operator  j 
if  he  succeeds  on  subtask  i,  or  chooses  the  second  alter  - 
native  course  in  a  decision  subtask. 

9.  subtask  number,  dy  (mnemonic  delay):  which  must  be  suc¬ 
cessfully  completed  by  his  partner  before  operator  j  can 
begin  subtask  i.  By  proper  selection  of  d^j  values,  it  is 
possible  to  cause  either  operator  to  "wait"  until  his  part¬ 
ner  has  completed  a  stipulated  subtask  successfully.  Thus, 
"waiting"  for  one’s  partner  is  simulated  differently  from 
time  spent  "idling"  until  a  fixed  time  as  in  5  above. 

10.  indication  of  whether  or  not  subtask  i  for  operator  j  is  a 
special  subtask  in  which  the  operators  communicate  with 
each  other. 

E 

11.  time,  Tjj  :  required  to  perform  all  remaining  essential 
subtasks  (including  i)  at  average  execution  times,  assum¬ 
ing  no  failure.  With  no  branching  or  decisions: 


n 


12.  time,  T^j:  required  to  perform  all  remaining  non-essential 
subtasks  (including  i)  at  average  execution  times,  assuming 
no  failures. 


13.  indication  of  a  special  type  of  subtask: 

a.  a  joint  or  team  decision 

b.  a  subtask  to  be  skipped  by  j  if  a  specified 
subtask  is  ignored  by  j' 

c.  an  equipment  delay  subtask 

14.  special  (i,  j)f  and  (i,  j)s,  like  7  and  8  above  for  use  on  special 
subtasks. 
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Table  1 


Examples  of  Average  Execution  Times  and  Standard  Deviations 
_ for  Representative  Operator  Actions* _ 


Average  Average 
Execution  Standard 
Time  Deviation 

t.. 

i] 

Operator  Action  (sec. ) 


ij 

(sec. ) 


Set  Toggle  Switch 

Set  Rotary  Control 

Push  Button  (or  foot  switch) 

Lever  (throttle)  Setting 
Joystick  Setting 

Read  Instrument,  N  Instruments 
Communication,  N  Words 

Ignore  Non-essential  subtask  when  situation  is 
"highly  urgent" 


1.  1 
8.6 
4.  2 
3.0 
3.8 

0.  6N  +  0.  6 
0.66N  +  0.6 

0.6 


0.76 
3.  00 
1.  02 
0.48 
0.48 

0.  2N  +  0.  2 
0.  34N  +  0.  4 


*  Each  t^j  value  includes  0.  6  sec.  to  allow  for  attention  shift  between  subtasks, 
and  similarly  each  <r^  includes  0.  2  sec.  Data  given  are  for  field  conditions. 

In  highly  controlled  laboratory  situations,  these  data  should  be  reduced  by  50%. 


Parameters  and  Initial  Conditions 

The  other  data  required  by  the  computer  in  advance  of  the  simulation  are 
the  parameters  and  initial  conditions.  These  permit  the  adjustment  of  critical 
variables  and  the  consequent  determination  of  the  range  of  their  effects.  In 
order  to  simulate  intra-  and  inter -individual  differences  of  performance,  the 
simulation  of  any  individual  subtask  is  based,  in  part,  on  a  random  process. 
Because  of  this  stochastic  effect,  it  is  necessary  to  repeat  the  simulation  of  a 
task  many  times  in  order  to  obtain  sufficient  performance  data  for  each  set  of 
conditions.  The  parameter  N  is  used  to  indicate  the  number  of  times  a  given 
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task  is  to  be  simulated;  there  are  N  simulations  (or  N  iterations)  per  computer 


Another  initial  condition  is  Rq,  the  nine  digit  number  from  which  the  com¬ 
puter  generates  subsequent  pseudo-random  numbers  R. ,  R_,  R„,  ....  needed 

1  4  O 

during  the  course  of  the  simulation.  The  term  "pseudo-random"  is  used  because 
the  last  number  generated  in  one  run  is  used  as  the  first  value  in  the  next  run 
and  thus  any  random  number  generated  is  not  wholly  independent  of  the  last. 

The  distributions  of  pseudo-random  numbers  as  generated  are  indistinguishable 
by  reasonable  statistical  tests  from  numbers  which  result  from  a  truly  random 
or  stochastic  process. 

Three  pairs  of  parameters  may  be  varied  from  run  to  run  in  order  to 
evaluate  either  the  model  or  a  man-machine  system.  The  stress  thresholds, 

Mj,  one  for  each  operator,  maybe  considered  as  the  operator's  "breaking 
point.  "  For  example,  an  value  of  2.  0  indicates  that  the  operator  begins  to 
become  slower  and  less  accurate  at  the  point  at  which  he  has  more  than  twice 
as  much  to  do  (at  average  speed)  as  he  has  time  available.  Prior  to  this 
point,  any  added  backlog  of  essential  subtasks  induces  stress  which  affects 
the  operator's  actions  so  that  they  become  faster  and  more  accurate. 

The  parameters,  T.,  are  the  total  times  allotted  to  each  operator  for 
J 

performance  of  the  whole  task.  For  a  two-man  team,  the  task  is  considered 
to  have  been  successfully  completed  if  both  operators  complete  all  required 
subtasks  within  the  time  specified  by  the  larger  of  the  two  values. 
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The  parameters,  F.,  which  account  for  variance  among  individuals, 

J 

are  termed  the  individuality  factors  for  the  two  operators.  is  a  multipli¬ 
cative  factor  with  a  value  of  unity  for  the  average  operator.  For  faster  or 


more  highly  motivated  operators  (F.  <  1),  and  for  slower  operators  (F.  >  1). 

J  J 


The  Random  Interrupt  Feature 

Four  additional  initial  conditions  are  associated  with  a  new  feature 
which  provides  for  the  simulation  of  an  event  which  interrupts  a  team  during 
its  task  performance.  This  feature  enables  simulation  of  tasks  during  which 
an  unexpected  event  occurs  to  interrupt  one  or  both  operators.  It  is  assumed 
that  the  one  such  interrupt  which  is  permitted  in  each  task  simulation  will  oc¬ 
cur  at  any  time  between  the  beginning  of  the  task  and  T*  seconds  later  with 
equal  probability.  The  interrupt  occurs  on  a  given  simulation  with  probability 
P*  and,  if  it  occurs,  the  interrupt  will  have  a  duration  which  is  normally  dis- 
tribule  around  t*  seconds  with  a  standard  deviation  of  a *  seconds. 


The  Simulation  Sequence 

Having  stored  the  program  parameters,  and  initial  conditions,  the 
computer  begins  processing  the  data  in  accordance  with  the  logic  shown  in 
Figure  1.  To  determine  whether  or  not  an  interrupt  is  to  occur  on  the  forth¬ 
coming  simulation  a  pseudo-random  number,  R^,  uniformly  distributed  over 
the  unit  interval  is  generated,  using  the  power  residue  method,  from  Rq.  The 
interrupt  will  occur  if  P*is  less  than  R^.  In  the  event  that  an  interrupt  is  to  oc¬ 
cur,  the  duration  of  the  interrupt  is  calculated  as: 
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Figure  1  Flow  chart  of  man-machine  simulation  model 
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(Figure  1  continuation) 


O! 


12 


(Figure  1  continuation) 


D1  =  t1  +  Ko-1  >  0 

u  v  /  01  d  \l/2  cos  2ttR  or 
where  K  =  (^lnR^)  3 

1/2 

(- 21nR^)  '  sin  27rR^,  alternatively. 

Since  K  is  calculated  to  be  a  random  deviate,  the  interrupt  duration  will  be 
normally  distributed  around  the  mean  t*  with  standard  deviation  o-*.  The  time 
at  which  the  interrupt  will  occur  is:  T°  =  T *  .  R^,  i.  e.  ,  equally  probable  at 
any  time  from  the  beginning  to  the  time  T*. 

The  computer  determines  the  sequence  of  subtasks  to  perform  in  accord¬ 
ance  with  (i,  j)  and  (i,  j)  input  data.  Its  determination  of  which  operator  to  simu 

S  I 

late  at  any  given  time  in  the  sequence  depends  upon  T^,  the  total  time  used  by 
operator  j  while  "performing"  all  subtasks  from  the  start  of  the  simulation 
through  subtask  i-1.  The  operator  having  the  smaller  T^  value  is  selected,  and 
his  next  subtask  is  simulated.  Subtasks  are  simulated  in  turn  until  the  task  is 
completed  or  until  all  time  allotted  has  been  used. 

Decision  Subtasks 

An  operator  may  find  it  desirable,  or  external  conditions  may  require 
him  to  skip  one  or  more  subtasks  or,  having  reached  a  critical  point,  to  select 
one  of  several  alternative  courses  of  action.  The  decision  subtask,  incorporated 
to  enable  such  branching,  skipping  and  looping,  causes  the  computer  to  select 
the  next  subtask  without  "consuming  operator  time.  "  Decision  subtasks  may 
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be  placed  anywhere  in  the  sequence.  For  these,  t..,  <r..,  and  essentiality  have 
no  meaning.  The  calculation  of  execution  time  is  bypassed  and  the  last  pseudo¬ 
random  number,  R„,  from  the  previous  subtask  is  compared  against  the  p>  of 
the  decision  subtask.  Therefore,  the  next  subtask  to  be  performed  as  a  result 

of  the  decision,  is  subtask  (i,j)  with  probability  p. .,  or  subtask  (i,  j )  with 

s  1]  f 

probability  1  -  p.^. 


Waiting  and  Idling 

If  one  operator  must  wait  for  another,  the  sequence  continues  using 
data  for  the  other  operator.  Then  a  determination  is  made  as  to  whether  the 
operator  must  idle  until  an  amount  of  time  I.,  has  elapsed  from  the  beginning 
of  the  simulation.  If  idling  is  required,  the  idle  time  I..  -  T^  is  recorded, 
totals  accumulated,  T„  set  equal  to  I  and  the  control  returned  to  determine 
which  operator  to  simulate  next.  If  no  idling  is  required,  a  determination  is 
made  of  whether  or  not  subtask  i  is  a  communication  subtask.  If  it  is,  the 
operators  are  synchronized  by  setting  the  total  time  used  by  both  to  that  of 
the  one  who  has  taken  longer.  This  may  result  in  a  wait  for  either  operator 
and  is  treated  as  the  wait  ^escribed  above. 


Equipment  Delays 

Before  computing  each  operator's  stress  and  urgency  conditions,  the 
computer  determines  whether  the  subtask  being  simulated  is  an  equipment 
delay  subtask.  This  type  of  subtask,  which  can  appear  wherever  desired  in 
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the  subtask  sequence,  provides  for  the  case  in  which  a  delay  is  introduced  and 
time  is  used  due  to  factors  other  than  operator  performance.  The  technique 
for  determining  the  time  used  in  this  case  is  similar  to  the  calculation  of  sub¬ 
task  execution  time  discussed  later- -but  without  the  effects  of  operator  stress 

involved.  The  time  is  calculated  from  a  normal  distribution  with  mean  t. .  and 

U 

standard  deviation  o\.. 

U 

Urgency  and  Stress 

For  other  types  of  subtasks,  one  of  three  states  of  "urgency"  is  de¬ 
termined  for  each  operator.  Urgency  is  based  on  the  remaining  time  avail¬ 
able  to  an  operator  for  completing  the  task,  the  average  time  required  to  com¬ 
plete  the  task  if  no  failures  occur,  and  the  operator's  individuality  factor: 

1.  The  situation  is  non-urgent  when  sufficient  time  remains 
to  complete  all  remaining  subtasks. 

2.  The  urgent  state  occurs  if  the  time  available  is  insufficient 
for  completing  all  remaining  subtasks,  but  sufficient  to 
complete  all  remaining  essential  subtasks. 

3.  The  situation  is  highly  urgent  if  there  is  insufficient  time 
available  for  completing  even  the  remaining  essential  sub¬ 
tasks. 

In  the  urgent  and  highly  urgent  conditions  the  computer  ignores  the  non-essential 
subtasks. 

Following  the  determination  of  the  degree  of  "urgency,  "  the  stress^  con¬ 
dition  is  calculated.  Current  psychological  theory  suggests  that  emotion  or  stress 
acts  as  an  organizing  agent  on  behavior  up  to  a  certain  point,  and  beyond  it  as  a 
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disorganizing  agent.  Accordingly,  the  model  recognizes  an  organizing  effect 

on  operator  performance  as  long  as  s_  (the  stress  upon  operator  j  just  prior 

to  his  performance  of  subtask  i)  is  less  than  a  threshold  value  M^:  if  s_  equals 

or  exceeds  M.,  the  effect  is  disorganizing.  During  non-urgent  and  urgent  con- 
] 

ditions  s„  is  defined  as  equal  to  unity;  when  the  situation  is  highly  urgent, 
stress  is  defined  as  the  ratio  of  the  sum  of  the  average  execution  times  for  the 
remaining  essential  subtasks  to  the  total  time  remaining: 


T" 

s  =  _ il_ 

ij  T  .  TU 
j  ij 


1.  0  <  s..  <  5.  0 

-  ij  ~ 


In  other  words,  stress  is  the  ratio  of  how  much  is  left  to  do,  to  the  amount  of 
time  available  in  which  to  do  it. 

Since  each  operator  has  an  individual  time  limit  on  his  performance  and 
a  task  failure  occurs  only  when  the  larger  of  these  limits  is  exceeded,  it  is  pos¬ 
sible  for  the  simulation  to  continue  with  one  operator  (arbitrarily  selected  as 
operator  1)  having  exceeded  his  limit.  Should  this  be  the  case,  the  stress  con¬ 
dition  of  this  operator  is  set  equal  to  his  threshold  value,  M^,  for  the  remainder 
of  the  simulation. 
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Team  Cohesiveness 


The  model  attempts  to  simulate  the  operator's  confidence  in  or  co¬ 
hesiveness  with  his  partner.  Lack  of  team  cohesiveness  may  reflect  disagree¬ 
ments  about  goals  or  their  importance,  or  about  methods,  or  locus  of  authority 
An  operator  can  often  tell  how  well  his  partner  is  performing:  when  one  oper¬ 
ator  "feels"  that  his  partner  is  not  performing  satisfactorily,  he  will  probably 
modify  his  own  actions.  The  model  provides  for  this  contingency  by  adding  to 
the  stress  value  for  one  operator  if  his  partner  has  a  stress  value  greater  than 
unity.  The  additive.  A,  is  calculated  as  follows: 


r  o 


A  =  < 


a..,  -  1 

u' 

M.,  -  1 
J1 


L  1 


if  s..,  =  1 
ij' 


if  1  <  s. . .  <  M. , 
ij '  “  1 ' 


if  s. . .  >  M. 
xj1  y 


where  j'  denotes  the  partner.  The  value  A  +  s..  =  S..  is  used  in  later  calcu¬ 
li  iJ 

lations  of  subtask  performance  time. 

An  index  of  cohesiveness,  C„,  is  also  calculated  for  each  operator  on 
each  subtask  as  a  measure  of  the  joint  stress  condition  of  the  team.  It  is  the 
product  of  the  stress  levels  of  the  two  operators  normalized  by  their  respective 
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stress  threshold  values: 


(s..s.  )  -  1 

c  =  jj-a! _ 

ij  (M  M  )  -  1 

J  J 


When  neither  operator  is  under  stress,  C...  =  0.  If  the  stress  on  both  operators  is 
equal  to  their  thresholds,  C„  =  1.  Thus,  increasing  C„  values  indicate  greater 
team  discontinuity. 


Subtask  Execution  Time 

Next,  the  execution  time  of  the  subtask  is  computed.  The  average  opera¬ 
tor  will  require  t„  seconds  to  perform  subtask  i  when  S„  =  1.  In  this  case,  his 
average  standard  deviation  will  be  o-  .  Of  course,  no  two  operators  would  be  ex¬ 
pected  to  perform  any  subtask  in  exactly  the  same  time  on  each  repetition,  and  no 
operator  would  be  expected  to  perform  the  same  task  identically  on  two  occasions 
except  by  chance.  For  each  subtask,  it  is  assumed  that  the  actual  subtask  execu¬ 
tion  time,  t.j,  is  normally  distributed.  The  current  model  provides  two  alternative 
schemes  of  computing  the  execution  time.  The  desired  function  can  be  selected  by 
appropriate  computer  switch  setting  prior  to  simulation.  In  both  cases,  specific 
values  for  t„  are  selected  by  a  random  or  Monte  Carlo  technique  from  a  normal 
distribution  limited  from  below  by  a  fixed  minimum,  selected  as  0.  75  sec.  Pseudo¬ 
random  numbers  R^  and  R2  uniformly  distributed  in  the  unit  interval  are  se¬ 
quentially  generated  by  the  computer  from  R^  as  before.  From  these  numbers, 
corresponding  values  of  an  independent  random,  normally  distributed  variable 
are  generated.  Thus,  if  K„  is  the  number  of  standard  deviations  from  the 
mean  corresponding  to  the  random  numbers  generated  in  simulating  subtask  i 


-  18  - 


if  S. .  <  M. 
ij  3 

if  M.  <  S, .  <  M.  +  1 
3-  iJ“  J 

if  S.,  >  M.  +  1 
ij  3 


Alternate  Execution  Time  Calculation 

A  revised  function  for  t. .  has  been  derived  and  is  effective  only  in  the 

13 

region  in  which  the  augmented  stress  of  the  operator  iB  below  his  threshold. 
This  revised  function  therefore  replaces  only  the  first  of  the  three  formulae 
above.  It  was  determined  as  a  result  of  data  collected  during  laboratory  in¬ 
vestigations  in  connection  with  a  prior  man-machine  simulation  (Siegel,  Wolf, 
and  Sorenson,  1962).  A  discussion  of  the  derivation  of  the  function  is  given  in 
Appendix  A.  The  revised  execution  time  is: 


for  operator  j,  then  in  the  original  scheme  is  given  by: 

fY.F. 

1.1  3 


[(2S. .  +  1  -  2M.)  V..  -  (S..  -  M)X.]  F. 
13  3  i3  13  i3  3 

[3V  .  -T.J  F. 
v.  *3  13  3 


where  V. .  =  t. .  +  K.,  cr. . 

13  13  ij  13 

and  K  is  defined  as  before. 


F  V  Z 

j  ij  ij 


-1. 82900 


\s 


V  *.• 


■2.  35075(' 


m.  -  i>  +  3-472V -1 

3  3 

SM " 1 


V 


m.  -  r 
3 


)  + 1.0 


if  S.,  <  M 

ij  : 
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The  effect  of  the  above  is  to  provide  a  t 


ij 


value  selected  from  a  normal 


distribution  in  which  the  values  of  t 


ij 


and  <r 


ij 


are: 


1.  used  unchanged  when  stress  equals  unity 

2.  decreased  linearly  (alternate:  cubic  function)  with  increas¬ 
ing  stress  until  stress  assumes  the  threshold  value 

3.  used  unchanged  when  stress  equals  the  threshold  value 

4.  increased  linearly  with  increasing  stress  beyond  the 

threshold  until,  when  stress  equals  Mj+1,  the  contribu- 
tions  of  tjj  and  o-j.  remain  constant  at  2t„  and  3o\  re¬ 
spectively.  J  J  3 


The  comparison  of  these  functions  is  shown  graphically  in  Figure  2. 
Subtask  Success  and  Failure 

The  model  assumes  that  the  actual  probability  of  successful  perform¬ 
ance  of  a  given  subtask,  p^  is  a  function  of  p^,  s^,  and  as  follows: 


r  <1  -  » 

pij  Mj  -  1 


pu  '1  V8« + 1 '  +  <Mj  •  V 


v2PU  '  * 


if 


if  M  <  By  <  M  +  1 


if 


! 


-  20  - 


! 


21 


AU6MENTED  STRESS  S|J 

Figure  2.  Average  execution  time  ae  a  function  of  stress. 


Thus,  the  probability  of  success  increases  linearly  with  stress  from 
a  value  of  until  it  assumes  a  value  of  unity  at  the  stress  threshold.  Follow¬ 
ing  this  point,  the  probability  assumes  the  average  value,  p^  after  which  it  de¬ 
creases  linearly  until,  when  stress  has  a  value  equal  to  +  1,  it  levels  off  at 
a  value  which  is  decreased  from  p^  by  an  amount  equal  to  1  -  pu.  In  order  to 
determine  actual  success  or  failure  for  any  subtask,  the  computer  generates  a 
pseudo-random  number,  R^,  uniformly  distributed  over  the  unit  interval  from 
Rg-  The  operator  is  considered  to  have  performed  the  subtask  successfully  if 
Rg  is  less  than  p^;  otherwise  he  is  assumed  to  have  failed.  This  implies  that 
there  will  be  a  failure  with  probability,  p^,  in  the  long  run. 

To  facilitate  the  calculation,  these  expressions  were  rearranged  to  in¬ 
dicate  success  if: 


(M  -  1)R  -  s..  +  1 
— J  3 

Mj '  'u 


<  P 


ij 


when  s..  <M, 

ij  j 


Bjj  '  Mj  *  R3 
8ij  ‘  Mj  +  1 


<  P 


ij 


when  M  <  8^  <  M  +  1 


R3  +  l 


<  P. 


ij 


when  Sjj  >  M  +1 


The  computed  left  hand  member  of  these  inequalities  is  called  the  probability 
term  and  is  made  available  as  a  printed  result.  In  event  of  either  success  or 
failure,  input  information  indicates  the  subtask  which  is  performed  next. 
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Multiple  Action  Subtasks 


In  certain  subtasks,  such  as  joystick  and  trim  settings,  several  trials 
of  the  same  action  are  usually  required  although  a  single  action  may  occasion¬ 
ally  be  successful.  These  subtasks  are  organized  for  the  computer  as  requiring 
a  single  control  action  with  a  relatively  low  probability  of  success.  The  prob¬ 
ability  of  success  on  any  single  trial  is  determined,  using  the  formula  that  if  p 
is  the  probability  of  success  on  a  single  trial  and  p*  is  the  probability  of  at 
least  one  success  after  n  trials,  then 

p  =  i  -  rvn— -~p*T 


Team  Decision  and  Special  Subtasks 

The  remainder  of  computer  operations  (starting  with  the  circled  i  of 
Figure  1)  are  concerned  with  bookkeeping,  updating  memory  values,  and  spe¬ 
cial  subtasks  prior  to  recording  of  results.  Special  subtask  type  1  provides 
the  facility  for  one  operator  to  make  a  decision  for  both  himself  and  his  partner. 
In  this  case,  p„  is  the  probability  associated  with  this  two-way  decision.  If  R^ 
is  less  than  p^  (normally  called  "success")  then  operator  j  takes  his  next  sub¬ 
task  as  indicated  in  (i,  j)  and  j'  takes  his  from  the  special  (i,  j)  .  Similarly, 

if  R,  exceeds  p..,  then  j  goes  to  the  subtask  indicated  by  (i,  j),  and  his  partner, 

1J  I 

to  the  subtask  indicated  by  the  special  (i,  j)^. 
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Special  subtask  type  1  can  also  be  used  to  cause  a  sequence  of  subtasks 
performed  by  one  of  the  operators  to  be  dependent  on  whether  or  not  his  partner 
has  skipped  a  given  subtask.  In  this  case  (when  I  is  not  negative,  indicating 
the  subtask  is  not  a  decision  subtask),  the  sequence  is  as  follows: 


(a) 

j 

goes  to 

(i,j)f 

(b) 

i 

goes  to 

U.j)s 

(c) 

3 

goes  to  special  (i,j)s 

(d) 

j' 

goes  to  special  (i,j)f 

if  he  performs  and  fails 
if  he  performs  and  succeeds 
if  he  ignores  the  subtask 
if  j  ignores  the  subtask 


Special  subtask  type  2  enables  a  single  operator  to  skip  one  or  a  block 

of  subtasks  depending  on  whether  or  not  he  ignores  a  designated  subtask.  For 

example,  if  operator  j  ignores  a  type  2  subtask,  then  his  next  subtask  will  be 

the  one  indicated  by  the  special  (i,j)  ;  if  he  does  not  skip,  he  will  take  (i,  j) 

s  s 

next,  and  upon  failure,  he  will  continue  with  subtask  (i,  j)^. 

Recording  of  Results 

The  model  is  organized  so  that  at  the  completion  of  calculations  for  one 
run,  any  combination  of  the  following  four  sets  of  recorded  results  may  be 
produced: 


(1) 

Detailed  results 

-  pertaining  to  individual  subtasks 

(2) 

Pseudo-random  numbers 

-  pertaining  to  individual  subtasks 

(3) 

Intermediate  results 

-  summary  for  each  simulation  or 
iteration 

(4) 

Final  results 

-  summary  for  all  N  iterations  of 
a  run 

-  24 


An  example  of  the  results  pertaining  to  each  subtask  (see  circled  q,  Figure  1) 
is  given  in  Table  2.  Table  2  is  a  direct  reproduction  of  data  prepared  by  the 
high  speed  printing  device  from  a  magnetic  tape  record  of  a  two-operator  task. 
The  table  shows  detailed  results  from  one  iteration  followed  by  the  correspond¬ 
ing  intermediate  results  (circled  u,  Figure  1).  All  time  and  stress  values  have 
two  decimal  places. 

Table  3  shows  a  sample  from  tabulations  of  the  pseudo-random  numbers, 

together  with  K  and  V  values.  Here,  leading  blanks  in  the  pseudo-random 

numbers  are  zeros:  V. .  and  K  have  two  decimal  places. 

ij 

Table  4  shows  an  example  of  the  results  printed  at  the  completion  of 
each  run. 
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CHAPTER  III 


COMPUTER  UTILIZATION 

This  chapter  contains  information  on  the  operation  of  the  IBM  705  III 
computer  for  the  man -machine  digital  simulation.  These  instructions  for  the 
operator  of  the  equipment,  dealing  primarily  with  card  and  magnetic  tape  for¬ 
mats,  are  presented  for  those  who  may  be  interested  in  applying  the  digital 
simulation  technique  described. 

Card  Formats 

Figure  3  shows  the  composition  of  the  computer  input  data  card  deck. 
Figure  3  displays  six  card  types  whose  contents  and  format  are  shown  in  Fig¬ 
ure  4.  Note  that  the  three  data  cards  for  the  first  desired  run  are  placed  in 
front  of  the  card  deck  of  operator  data  sets;  the  triplets  of  cards  for  as  many 
additional  runs  as  are  desired  are  placed  after  the  operator  data.  In  Figure  4 
a  +  sign  indicates  the  card  column  in  which  the  sign  of  the  data  field  is  given. 
In  accordance  with  standard  card  codes  Table  5  shows  the  proper  card  punch 
for  these  columns  which  combines  the  sign  and  digit. 
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CARD  NUMBER  FORMAT 


CARD  TYPE 


3 

2 

1 


3 

2 
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INITIAL  CONDITIONS 
AND  PARAMETERS, 
LAST  RUN. 


i 

i 


i 

i 


ETC. 


INITIAL  CONDITIONS 
AND  PARAMETERS, 
SECOND  RUN. 


SUBTASK  DATA,  END  CARD 

SUBTASK  DATA,  SECOND  OPERATOR 

OPERATOR'S  SUBTASK  SEPARATOR  CARO 

SUBTASK  DATA,  FIRST  OPERATOR 
PARAMETERS,  SECOND  OPERATOR 
PARAMETERS,  FIRST  OPERATOR 
INITIAL  CONDITIONS 


Figure  3.  Input  cord  composition. 
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MULTIPLE  LAYOUT  FORM 
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Table  5 


Proper  Card  Punch  for  Signed  Columns 


Proper  Card  Punch 
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R 

Options  of  the  Model 

The  six  Alteration  Switches  on  the  computer  operator's  console  have 
been  utilized  in  the  man-machine  model  to  provide  options  to  the  analyst-pro¬ 
grammer,  as  shown  in  Table  6.  In  addition,  if  it  is  desired  to  employ  the 
revised  method  of  determining  the  urgency  condition,  an  F  is  prestored  at 
location  39000  prior  to  computation.  Otherwise,  the  original  method  is  utilized 
(see  Chapter  II  -  Urgency  and  Stress  section). 
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916  Record  pseudo-random  number  Do  not  record  pseudo-  See  Table  3 


Operator  Instructions 


Prior  to  starting  the  one  or  more  runs,  tne  instruction  tape  is  loaded 
on  drive  0600,  and  two  blank,  or  scratch  magnetic  tapes,  are  loaded  on  drive 
0601  and  0605.  Punched  card  inputs  in  the  form  shown  in  Figure  4  are  loaded 
into  the  card  reader,  station  0100.  To  begin,  load  the  program  from  tape  us¬ 
ing  the  following  instructions:  20600  (select  600),  30018  (cpntrol  18),  Y000 
(read  0),  reset,  and  start.  The  program  will  be  read  in,  followed  by  card  data, 
and  there  will  be  a  HALT  to  allow  the  operator  to  set  the  Alteration  Switches 
and  to  load  an  F  in  39000,  if  desired.  The  calculation  may  then  be  initiated. 
Experience  has  suggested  the  computer  takes  about  0.  25  seconds  to  simulate 
each  operator  subtask.  Detail,  intermediate,  and  summary  results  are  re¬ 
corded  on  tape  drive  0601  in  the  format  of  Tables  2  and  4.  The  pseudo-random 
number  data  of  Table  3  are  recorded  on  tape  drive  0605,  if  selected.  The  tapes 
may  be  printed  via  the  standard  IBM  1401  print  programs.  After  each  run,  the 
computer  halts  to  allow  changes  in  Alteration  Switches  and  the  F  at  39000. 

A  detailed  listing  of  the  assembled  man-machine  simulation  program  is 
obtainable  on  a  loan  basis  from  Applied  Psychological  Services  and  will  be  loaned 
to  responsible  agencies  and  organizations  on  an  inter-library  loan  basis. 
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CHAPTER  IV 


THE  ONE -OPERATOR  TASK 


Task  Description  and  Analysis 

The  present  study  involved  the  simulation  of  a  pilot's  task  when  firing 
an  air-to-air  missile  in  a  lead  collision  attack,  as  .reported  by  Siegel  and 
Wolf  (1959b).  In  the  missile  firing,  proceeding  at  a  speed  of  about  800  feet 
per  second,  the  attack  begins  when  the  target  is  approximately  30  miles  dis¬ 
tant;  the  attack  is  concluded  when  at  least  two  miles  separate  the  target  from 
the  interceptor.  It  was  assumed  that,  the  pilot  would  take  advantage  of  every 
available  moment  until  he  was  two  miles  distance  (breakaway  point)  to  exe¬ 
cute  the  sequence  of  subtasks.  The  value  of  T  was  determined  from  the  best 
estimate  of  the  distance  traveled  by  the  intercept  aircraft  (28  miles  including 
maneuvers)  and  his  speed  of  about  80P  feet  per  second.  Thus,  the  value  of  T 
selected  was  184.  8  seconds.  A  general  diagram  of  the  missile  launching 
operation  is  presented  as  Figure  5.  A  simulation  run  was  considered  suc¬ 
cessful  only  if  all  subtasks,  including  breakaway,  were  completed  prior  to  T 
elapsed  seconds.  In  practice,  if  insufficient  time  remained  to  complete  the 
required  operations  action  prior  to  missile  launch,  the  pilot  would,  of  course, 
give  up  the  launching  sequence  and  breakaway.  The  task  analysis  data,  pre¬ 
viously  derived,  were  put  into  the  two-man  model  format  and  are  shown  in 
Table  7.  These  data  are  given  in  the  format  of  card  type  4  of  Figure  4. 
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36 


Figure  5  Diagram  of  the  launching  operation  (not  drawn  to  scale) 
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OPERATOR  1 


The  launching  task  is  divided  into  22,  23,  or  24  basic  subtasks  from 
the  start  of  the  maneuver  to  the  final  breakaway. 

Following  subtask  19,  a  decision  is  possible  (subtasks  20  and  25)  in 
accordance  with  the  following  (at  least)  three  equally  probable  alternatives: 

(1)  the  target  is  properly  centered  on  the  radar  scope; 
therefore  subtasks  21  through  24  are  to  be  performed 

(2)  the  target  is  too  high  on  the  radar  scope;  therefore 
subtasks  26  through  30  must  be  performed 

(3)  the  target  is  too  low  on  the  radar  scope;  therefore 
subtasks  31  through  36  must  be  performed 

Because  of  the  nature  of  the  launching  task,  subtask  number  18  could 
not  be  initiated  until  "lock-on"  had  occurred.  This  was  allowed  after  a  min¬ 
imum  of  79.  2  seconds  following  the  start  of  the  maneuver. 

The  interrupt  feature  was  not  used  in  this  particular  task  sequence. 

Outside  Criterion 

In  order  to  obtain  some  measure  of  the  agreement  between  the  results 
obtained  from  the  model  and  the  actual  performance  of  pilots,  data  has  been 
obtained  previously  (Siegel  and  Wolf,  1959b)  which  indicate  actual  pilot  launch 
results.  These  data,  called  the  outside  criterion,  were  compiled  from  the 
launching  data  of  11  pilots.  The  data  indicated  that  713  missile  launching  at¬ 
tempts  out  of  876  were  successful,  an  overall  probability  of  task  success  of 
81. 4%.  Here,  success  indicates  completion  of  all  subtasks  involved  in  missile 
launching  and  does  not  necessarily  imply  a  "kill.  " 
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Verification  Data  Runs 


A  total  of  18  computer  runs  were  performed  initially  to  verify  that  the 
two-man  model  (prior  to  any  modifications)  gave  reasonable  data,  as  well  as 
results  consistent  with  the  data  obtained  previously  using  the  one-man  simu¬ 
lation  model.  Each  run  consisted  of  88  simulations  with  a  time  limit  of  184.  8 
seconds,  as  before.  Each  required  about  nine  minutes  of  computation  (as  com¬ 
pared  to  one  hour  of  computing  on  the  IBM  650  Data  Processing  Machine  using 
a  simpler  model).  The  principle  result  of  this  effort--that  with  respect  to  fail¬ 
ure  probability- -is  shown  in  Figure  6.  Close  agreement  was  achieved  in  the 

frequency  of  failure  for  each  of  the  five  values  of  the  individuality  factor  (F.) 

J 

tested.  The  agreement  displayed  is  considered  well  within  the  accuracy  limits 
of  the  model  as  described  for  this  type  of  distribution  with  N  =  88  (Siegel  and 
Wolf,  1959b,  p.  16).  The  outside  criterion  data  for  failures  (18.6%)  is  equiva¬ 
lent  to  16.  3  failures  in  88  trials,  and  is  shown  on  Figure  6  as  an  arrow  at  the 
ordinate.  As  reported  for  the  one-man  model,  the  model's  predictions  were 
in  agreement  with  the  outside  criterion  data  only  for  fast  operators  (faster 
than  about  0.  91). 
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Task  Success --Modified  Model 


Following  these  computations,  15  additional  runs  were  made  on  the  com¬ 
puter  to  determine  effects  of  the  changes  to  the  model  on  its  performance.  Ta¬ 
ble  8  shows  the  principal  summarized  results.  Two  runs  of  88  iterations  were 

made  for  each  of  the  F.  =  1.0  entries  and  the  results  averaged;  one  run  was 

3 

made  for  the  other  F.  values.  A  failure  here  indicates  a  simulation  in  which 

3 

the  task  was  not  completed  by  the  simulated  operator  within  the  time  limit- -com¬ 
pletion  is  achieved  by  accomplishment  of  subtask  24,  30,  or  36.  A  graphic  dis¬ 
play  of  the  frequency  of  failure  is  given  in  Figure  7.  Again  the  outside  criterion 
value,  18.  6%  or  16.  3  out  of  88  failures  is  indicated  by  an  arrow  at  the  abscissa. 

The  major  result  is  that  for  the  average  operator  (F.  *  1.0),  the  revised  model 

3 

now  predicts  a  failure  frequency  which  corresponds  to  the  outside  criterion  value. 

This  occurs  at  a  stress  threshold  (M.)  range  value  of  1.  41  and  2.  70.  This  range 

3 

of  values  is  reasonable  in  that  it  is  in  reasonable  agreement  with  the  range  of 
Mj  values  (1.  9  to  2.  8)  for  which  agreement  between  the  model  and  reality  has 
been  previously  predicted  (Siegel  and  Wolf,  1961b). 

For  comparison,  the  predicted  failure  frequency  curve  of  the  unmodified 
model  (for  F^  =  1)  is  shown  as  a  line  of  Xs  in  Figure  7. 
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M. 
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0.  9 

1.  40 

8 

1.  95 

9 

2.  80 

10 

4.  00 

12 

1.  0 

1.50 

16 

2.30 

18 

2.80 

20 

4.  00 

22 

1.  25 

1.  50 
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3.00 
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1.4 
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65 
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2.4 

2.5 

49 
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1.5 

1.7 

84 
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Time  Remaining- -Modified  Model 


An  important  use  of  the  model  could  be  to  provide  quantitative  predic¬ 
tions  on  how  much  time  remains  to  the  operator  after  his  task  is  completed. 

No  field  data  were  available  for  the  launching  task  against  which  to  check  these 
computed  results  for  reasonable  correspondence  with  reality.  Although  these 
data  may  have  limited  value  in  the  validation  of  the  model,  they  would  be  im¬ 
portant  when  investigating  or  comparing  proposed  man-machine  systems. 

The  average  time  remaining  (in  seconds)  after  task  completion  for  each 
simulated  run  is  given  in  Table  8  and  displayed  in  graphic  form  in  Figure  8. 

The  data  are  based  only  on  those  simulations  which  were  successful  (i.  e.  ,  sub¬ 
task  24,  30,  or  36  completed).  Although  the  data  are  based  on  a  very  small 
sample  of  successful  simulations  for  some  runs,  they  are  sufficient  to  indicate, 
as  would  be  expected,  the  average  time  remaining  decreases  with  increasing 
M,  and  with  decreasing  F  values. 

This  is  in  confirmation  of  the  trend  of  results  achieved  on  the  one-man 
model.  For  comparison  purposes,  the  time  remaining  for  the  average  opera¬ 
tor  using  the  one-man  model  is  shown  in  Figure  8  as  a  line  of  Xs.  For  the  stress 
threshold  values  which  give  a  correspondence  of  the  model  with  outside  criterion 
data  in  failure  frequency  (M  =  1.  4  -  2.  7),  the  revised  model  indicates  an  average 
of  only  1.  3  to  2.  8  seconds  to  remain  after  successful  subtask  completion. 
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Figure  8.  Average  Time  Remaining 


Peak  and  Terminal  Stress 


Figure  9  presents  the  average  peak  stress  conditions  and  the  stress  con¬ 
ditions  at  the  end  of  the  computer  runs.  As  expected,  and  as  experienced  in 
previous  tests  of  the  model,  both  the  peak  and  the  terminal  stress  values  in¬ 
creased  with  increasing  F  values;  this  indicates  that  slower  operators  may  be 
expected  to  build  up  greater  stress  than  faster  ones.  This  finding  also  reflects 
the  fact  that  slower  operators  complete  less  work  in  a  given  time  and  consequent¬ 
ly  their  T^  -  T^j  values  (on  which  stress  depends)  are  lower. 

Discussion 

The  quantitative  outside  criterion  datum  available  on  the  selected  task 
was  success  probability.  The  results  presented  above  suggest  that  the  present 
model,  as  modified,  generated  predictions  for  the  task  considered  which  are  in 
good  agreement  with  the  criterion  data.  Qualitatively,  the  model  also  yielded 
results  for  other  variables  whose  trends  were  reasonable  and  consistent.  These 
variables  include: 


1.  time  remaining  after  task  completion 

2.  average  stress  after  task  completion 

3.  average  peak  stress 

These  are  the  primary  summary  data  of  interest  produced  by  the  computer  model 
for  this  task.  Other  information,  including  idle  times,  second  operator  data,  non- 
essential  subtasks  ignored,  and  interrupt  results  do  not  apply  to  the  particular 
one-man  task  selected  due  to  the  inherent  nature  of  the  task. 


-  46  - 


2.9 


3. 


Mj 

stress. 


-  47  - 


Thus,  two  conclusions  may  be  inferred  from  the  results  presented. 

The  first  is  that  the  present  model  has  been  shown  to  possess  qualities  and 
to  generate  results  which  represent  and  show  a  state  of  development  for  the 
model  for  the  task  simulated  and  by  implication  for  a  task  of  the  complexity 
of  20-30  subtasks  and  with  gross  accuracy  estimated  to  be  about  5%  to  10%. 
Thus,  this  application  has  shown  another  in  a  series  of  encouraging  results 
and  represents  another  small  step  toward  the  larger  goal  of  generalized  man- 
machine  system  simulation. 

The  second  point  is  that,  due  to  the  nature  of  the  criterion  data,  this 
work,  although  a  valid  and  reasonable  test,  represents  only  a  limited  accom¬ 
plishment  in  model  verification  from  the  quantitative  aspects.  The  simulated 
dual  operator  experiment  (Siegel,  Wolf,  and  Sorenson,  1962)  partially  com¬ 
pensates,  to  some  degree,  for  this  lack  by  providing  a  controlled  experiment 
with  more  extensive  outside  criteria  data.  However,  to  evaluate  further  the 
model  and  the  recent  modifications  (random  interrupt,  special  subtasks,  etc.  ) 
another  controlled  experiment  was  planned  and  recently  executed. 

Corresponding  computer  runs  have  also  been  made.  A  report  on  this 
research  from  the  Applied  Psychological  Services  is  scheduled  for  distribu¬ 
tion  in  October,  1963,  and  is  expected  to  represent  still  another  step  in  the 
validation  of  this  type  of  model. 

One  additional  benefit  of  this  model  should  be  discussed.  It  is  the 
availability  of  the  extensive  data  from  the  detailed  (i.  e. ,  individual)  simula¬ 
tions.  In  this  report,  88  trials  or  simulations  were  computed  for  each  run. 
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Thus,  if  desired,  the  system  designer  or  applications  engineer  could  have  ob¬ 
tained,  in  addition  to  the  summerized  data  reported  and  displayed  above,  a 
detail  printout  of  the  timing,  actions,  stress  (and  for  a  two-man  task  interaction, 
delays,  interrupts,  etc.  )  for  every  subtask  simulated.  A  substantial  benefit 
could  be  derived  from  these  data  on  a  task  which  represents  a  new  or  untried 
system  or  equipment.  The  ranges  of  values  for  times  of  performance  of  specific 
subtasks,  as  well  as  the  stress  level  at  critical  points  would  be  particularly  im¬ 
portant.  Comparative  evaluation  of  these  detail  (subtask)  data  under  various 
parameter  value  conditions  could  be  exceptionally  valuable.  It  is  also  believed 
that  the  "feel"  for  the  task  derived  by  a  thorough  study  of  selected  detail  data 
including  the  level  of  task  complexity,  operator  timing,  and  stress  would  be 
even  more  important  to  man-machine  design  assistance  than  the  summary  data 
against  which  the  model  must  be  verified  in  its  present  state  of  development. 
Although  much  care  must  be  exercised  in  the  preparation  of  the  task  analytic 
data,  it  is  now  considered  that  for  selected  one  or  two-operator  tasks  the  model 
would  presently  be  utilized  for  general  system  characterization  and  comparative 
system  evaluation  both  at  the  summary  and  detail  results  level 
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CHAPTER  V 


SUMMARY  AND  CONCLUSIONS 


The  applicability  of  a  digital  computer  model  for  simulating  the  actions 
of  the  operator  of  a  two-operator  man-machine  system  for  uni-operator  simu¬ 
lations  was  tested.  Although  logical  expectancy  suggested  the  applicability  of 
the  model  to  this  purpose,  no  test  of  its  usability  in  this  regard  had  been  pre¬ 
viously  performed. 

Then,  in  order  to  increase  the  richness  of  the  simulation,  a  number  of 
modifications  were  introduced  into  the  model.  These  modifications  involved  a 
number  of  logic  changes  to  allow  consideration  of:  (1)  the  individuality  factor 
in  the  urgency  and  stress  calculations,  (2)  random  interrupts,  and  (3)  equip¬ 
ment  imposed  delays.  Additional  changes  involved  a  limitation  on  the  max¬ 
imum  possible  operator  stress  and  a  new  stress  function.  The  model  in  its 
present  form  was  described  in  detail  in  the  body  of  this  report.  To  test  the 
effects  of  these  modifications,  the  results  from  the  simulation  were  compared 
with  criterion  data  using  both  the  former  and  the  revised  model. 

The  data  emerging  from  the  first  aspect  of  the  work  suggested  that: 

1.  the  multi-operator  model  is  usable  for  uni-operator 
simulations 

The  comparison  of  the  results  of  the  revised  and  the  previous  model 
with  criterion  data  suggested  that: 

2.  the  modifications  increased  the  obtained  agreement 
between  the  simulation  technique  and  criterion  data 
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APPENDIX  A 


Derivation  of  Revised  t..  Function 

i] 
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DERIVATION  OF  REVISED  t..  FUNCTION 

_ a _ 


A  byproduct  of  laboratory  experiments  conducted  in  support  of  verifi¬ 
cation  of  the  two  man-model  (Siegel,  Wolf,  and  Sorenson,  1962)  was  a  group  of 


data  which  has  been  used  as  a  basis  for  determining  a  revised  function  for  t„,  the 
execution  time  of  subtask  i  by  operator  j.  Data  from  three  subjects  was  normal¬ 
ized  to  determine  execution  time  as  a  function  of  the  stress  level  S_,  and  the 

stress  threshold,  M..  This  function  is  valid  only  over  the  interval: 

3 


1.0  <S..  <  M. 
“  iJ-  3 


A  simple  detented  rotary  control  activation  situation,  consisting  of  31 
switch  settings,  was  employed  in  the  test.  Each  subject  was  initially  asked  to 
make  31  rotary  control  settings  at  a  rapid,  but  comfortable,  pace.  These  initial 
settings  were  used  to  obtain  his  average  time  required  to  set  the  31  controls.  He 
was  then  asked  to  try  to  make  the  same  31  settings  when  his  time  limit  was  0.  95 
of  his  normal  time;  then  0.  90  of  his  normal  time;  and  so  on  until  the  time  allowed 
was  0.  35  of  his  normal  time. 

The  stress  relationship  described  in  Chapter  D  was  assumed: 


S.. 

i) 


T. 

3 


where  T.. 
13 

TU 

ij 


T. 

3 


31  (time  per  switch  setting  with  no  stress) 
0  (assume  the  beginning  of  31  operations) 
average  time  for  the  100%  case  (no  stress) 
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It  was  also  assumed  as  an  approximation  that  the  following  relation¬ 


ship  holds: 

1..F. 

t  =  JA—1 

ij  s., 
i] 

Values  for  F.  and  M.  for  the  operators  were  previously  determined  via 
J  1 

laboratory  experiment.  For  each  of  the  fourteen  5%  data  trials  (from  100%  to 
35%)  the  following  data  were  computed  for  each  of  the  three  subjects: 


(1)  actual  time  observed,  per  switch 

(2)  nominal  non-stressed  time  for  31  switches 

(3)  stress,  S.. 

ij 

(4)  adjusted  execution  time,  t.. 

S..  -  1  1J 

(5)  ^ - j  ,  (normalizes  stress  from  1  to  M.  into  the 

j  common  interval  0  to  1) 

t.. 

(8)  (normalizes  the  execution  time  to  the  average, 

ij  j  ’  and  adjusts  for  F.) 


t.. 


A  plot  (Figure  10)  was  then  made  for  the  three  operators  showing 

S..  -  1  ij  j 


as  a  function  of 


Several  approaches  were  taken  to  fit  an  analytical 


M.  -  1 
3 

expression  to  the  data  given  in  Figure  9. 

The  technique  selected  (Scarborough,  1950)  enabled  the  determination 

t.. 

of  the  three  constants  of  the  cubic,  given  that  —  ^  =  1.  0  when  S..  =  1.  0.  The 

t . . r  .  ij 

1 

resultant  cubic  was: 
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z.. 

13 


1 

I  then 


where 


1 


! 


s..  -  1  3  s..  -  1  s..  ••  1 

=  -1.8290  fail - 7)  +  3.  4722  fa^ - 7) -  2.  35075  fa-*1 - 7)  +  1.0 

M.  -  1  M.  -  1  M.  -  1 

3  3  3 

and  1.0  <  S. .  <5.0 

“  13  “ 


t..  =  F.Z..V..  >  0.  75 
13  3  13  13 


V..  =  t..  +  Kr,„  as  explained  in  Chapter  II. 
13  13  13 
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APPENDIX  B 


Calculation  of  Pseudo -Random  Numbers  and  Random  Deviates 


CALCULATION  OF  PSEUDO-RANDOM  NUMBERS  AND  RANDOM  DEVIATES 


The  use  of  the  model  requires  the  sequential  generation  of  pseudo-ran¬ 
dom  numbers,  uniformly  distributed  in  the  unit  interval  0-1.  The  method  se¬ 
lected  for  generation  of  these  numbers  is  the  power  residue  method  described 
by  IBM  (1959).  This  general  method  as  applied  to  the  model  705  computer  may 
be  summarized  as  follows: 

1.  select  any  starting  value  of  9  digits,  R^ 

2.  form  the  product  10003  R^ 

3.  the  least  significant  9  digits  of  the  product  is  Rj^ 

4.  each  successive  pseudo-random  number,  Rm+1> 
is  obtained  from  the  9  low  order  digits  of  the 
product  10003  R 

m 

By  this  method,  a  given  pseudo -random  number  is  dependent  upon  the 
preceding  one  and  the  process  is  acceptable  only  since  the  quantity  of  num¬ 
bers  generated  by  the  computer  before  repetition  is  large.  The  method  pro¬ 
duces  approximately  50,  000,  000  nine  digit  pseudo-random  numbers  before 
repetition.  Employment  of  this  method  permits  the  exact  repetition  of  any 
simulated  task  or  subtask  if  the  initial  random  number  for  that  task  or  sub¬ 
task  is  known.  The  exact  repetition  of  a  random  process  is  thus  facilitated 
by  the  recording  of  initial  Rq  values  for  each  iteration  and  enables  detailed 
review  of  any  selected  simulated  task. 
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In  the  calculation  of  t„  and  D*.  it  is  necessary  to  generate  values  of  a 
random  variable  with  a  frequency  function  equivalent  to  that  of  the  normal  dis¬ 
tribution  (i.  e.  ,  a  random  deviate).  This  was  done  by  the  direct  method  dis¬ 
cussed  by  Box  and  Muller  (1958)  and  by  Muller  (1959).  This  method  gives 
higher  accuracy  than  previous  methods  and  also  compares  favorably  with  oth¬ 
er  methods  in  computation  speed.  The  technique  is  based  on  the  availability 

of  two  random  numbers  in  the  unit  interval,  R  and  R  taken  from  the 

m  m+l 

same  rectangular  density  function  (see  preceding  section).  Then  and 

X,  =  (-21n  R  )^cos2ttR  _ 

1  m  m+l 

X2  =  (-21„Rm)1Bi„2irRmtl 

are  a  pair  of  independent  random  variables  from  the  same  normal  distribution 
with  a  mean  of  zero  and  unit  variance.  This  method  is  reported  to  produce 

-7 

normal  deviates  with  a  precision  of  approximately  5  x  10  except  for  prob- 

”8 

abilities  less  than  4  x  10 
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